Evaluating one-shot tournament predictions

We introduce the Tournament Rank Probability Score (TRPS) as a measure to evaluate and compare pre-tournament predictions, where predictions of full tournament results are required be available before begins. The TRPS handles partial ranking teams, gives credit that only slightly wrong, can modified with weights stress importance particular features prediction. Thus, Prediction is more flexible than commonly preferred log loss score for such tasks. In addition, we show how from historic tournaments optimally combined into ensemble in order maximize new tournament.